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ABSTRACT 

This  study  analyzed  the  Fiscal  Year  1975  Marine  Corps 
enlistment  productivity  and  recruiting  effort  in  the  State 
of  California.   Twelve  variables  describing  the  public  high 
schools  in  California  were  used  to  predict  enlistment  produc- 
tivity and  recruiting  effort. 

It  was  determined  that  productivity  could  be  predicted 
on  the  basis  of  recruiting  effort  alone.   This  meant  that  the 
recruiting  substations  in  this  study,  on  the  average,  achieved 
their  productivity  goals.   Recruiting  effort  was  found  to  be 
applied  on  the  basis  of  male  minority  students  enrolled  in 
vocational  education  programs  and  in  school  districts  that 
had  a  high  percentage  of  their  income  from  local  sources. 

A  measure  of  recruiting  effectiveness  was  proposed.   The 
model  developed  in  the  study  gave  a  predicted  productivity 
figure  for  a  cross-validation  sample  of  thirteen  recruiting 
substations.   The  actual  productivity  of  each  substation  was 
compared  to  the  predicted  value.   This  ratio  was  used  as  the 
measure  of  effectiveness 
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INTRODUCTION 

A .  BACKGROUND 

The  United  States  Marine  Corps  actively  recruits  young 
men  and  women  in  the  18-24  age  range.   This  is  done  in  compe- 
tition with  the  other  military  services  and  the  civilian  labor 
market.   This  competition  intensified  when  the  draft  was  elim- 
inated in  1973. 

In  the  spring  of  1975  the  Senate  Armed  Services  Committee 
questioned  whether  the  Marine  Corps  was  sacrificing  quality 
with  certain  segments  of  its  forces  to  retain  overall  numbers 
of  people  and  highly  sophisticated  weapons  systems.   The 
Commandant  of  the  Marine  Corps  submitted  a  report  t  ^ Ref .  \J 
in  response  to  this  committee's  questions.   His  report  con- 
cluded that  the  overall  quality  of  first-term  enlisted  Marines 
fell  below  the  high  level  desired  in  the  past  four  years. 
The  report  stated  that  inadequate  emphasis  was  being  placed 
on  the  importance  of  recruiting  high  school  graduates  to 
maintain  a  quality  force.   One  of  the  actions  taken  to  correct 
this  deficient  manpower  quality  was  to  require  that  67%   of 
all  recruits  be  high  school  graduates  in  fiscal  year  1976  and 
75%   in  fiscal  year  1977- 

B.  REVIEW  OF  THE  LITERATURE  ON  RECRUITING 

In  recent  years  that  have  been  many  studies  of  the  recruit- 
ing efforts  of  the  military  services. 


1.   Studies  Published  in  1972 

Cook  and  White  /~Ref .  2_7  in  1970  examined  the  quality 
of  Air  Force  recruits  (quality  was  measured  by  an  index 
constructed  from  weighted  percentile  scores  on  the  Armed 
Forces  Qualification  Test)  as  a  function  of  net  advantages 
(the  present  value  of  an  enlistment  term  in  the  Air  Force 
divided  by  the  present  value  of  the  income  an  individual  could 
receive  in  the  civilian  economy);  draft  pressure;  unemployment 
rate  (seasonally  adjusted  unemployment  rate  for  males,  ages 
16-19);  population  (the  number  of  civilian,  noninstitutinalized 
males,  ages  16-20);  airmen  recruits;  and  six  variables  to 
account  for  changes  occurring  outside  the  model.   One  variable 
represented  the  Berlin  crisis  of  1961  when  75.000  reserves 
were  called  to  active  duty.   A  second  variable  represented 
the  period  when  a  marriage  deferment  exempted  all  married 
young  men  from  the  draft.   A  third  variable  represented  the 
Vietnam  War  which  changed  young  men's  perception  of  military- 
service  and  thereby  affected  the  overall  quality  of  volunteers. 
In  addition  Cook  and  White  included  three  variables  to  account 
for  seasonal  variation  in  recruit  quotas  and  recruit  quality. 
Their  data  consisted  of  quarterly  observations  of  these  var- 
iables from  the  first  quarter  of  1959  through  the  second  quarter 
of  I967.   They  concluded  that  the  military-to-civilian  earnings 
ratio  was  the  most  significant  variable  for  quality  changes  in 
airmen  recruits. 

In  1972  Stephan  and  Horowitz  /~Ref .  3_7  studied  recruit- 
ing quotas  and  the  distribution  of  canvassers  (recruiters). 
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They  examined  the  number  of  recruits  as  a  function  of  the 
district  recruited  from  (territory),  the  number  of  canvassers, 
and  the  size  of  the  eligible  population  seasonally  adjusted. 
They  used  data  from  the  eight  Navy  recruiting  districts  for 
a  seven-month  period  (Sept.  1971-Mar.  1972).   They  found  that 
the  overall  total  number  of  recruits  attained  was  not  very 
sensitive  to  changes  in  the  distribution  of  canvassers.   The 
implication  was  that  recruiters  attained  their  recruiting 
quotas  regardless  of  area  assignment. 
2.   Study  Published  in  1973 

In  1973  Bennett  and  Haber  /~Ref .  kj   investigated  the 
factors  which  influence  the  productivity  of  individual  Marine 
recruiters.   They  examined  gross  productivity  (average  number 
of  recruits  enlisted  per  month)  for  each  recruiter  as  a  func- 
tion of  16  variables  describing  the  recruiter's  characteristics. 
These  explanatory  variables  were  as  follows:   GCT  score,  age, 
race,  level  of  education,  volunteered  for  recruiting  duty, 
previous  duty  as  a  career  planner  (a  reenlistment  counselor), 
number  of  dependents,  financial  hardship  (recruiter's  percep- 
tion of  the  financial  burden  of  recruiting  duty) ,  distance 
from  home  of  origin,  the  type  of  area  assigned  to  (urban, 
suburban,  or  rural) ,  number  of  times  reassigned  to  a  different 
area  on  the  current  tour  of  recruiting  duty,  hours-per-week 
spent  recruiting,  time  out  of  the  office  spent  on  recruiting, 
months  on  recruiting  duty  (current  tour)  and  the  recruiter's 
class  standing  in  recruiter  school. 
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The  sample  consisted  of  29  recruiting  stations  (RS) 
from  all  sections  of  the  country.   These  stations  provided 
information  on  259  recruiters  for  fiscal  year  1971.   Using 
this  data,  Bennett  and  Haber  found  that  not  all  of  the  var- 
iation in  average  monthly  productivity  among  recruiters  could 
be  attributed  to  differences  in  recruiter  characteristics. 
They  also  found  that  some  areas  of  the  country  were  more 
productive  than  others  in  that  the  propensity  to  enlist  was 
higher.   This  meant  that  the  enlistment  rate  (number  of 
enlistments  divided  by  number  of  qualified  males)  varied  by 
region.   They  further  concluded  that  recruiters  who  worked  in 
areas  near  their  home  were  likely  to  have  an  advantage,  as 
did  a  recruiter  who  worked  in  urban  or  suburban  environment 
instead  of  in  a  rural  area.   Because  the  explanatory  variables 
explained  only  12$  of  the  variance  in  recruiter  productivity 
they  considered  their  model  to  lack  predictive  power.   They 
found  that  the  most  important  determinant  of  gross  productivity 
was  the  propensity  to  enlist  in  an  area. 
3.   Studies  Published  in  19 7 ^ 

In  19?^  Waller  /~Ref .  5_7   produced  a  condensation  of 
a  study  done  in  1972  by  Johnston,  Jerome,  and  Bachman  /~Ref . 
6_y.      The  objective  of  the  study  by  Johnston,  Jerome,  and 
Bachman  was  to  discover  what  factors  influenced  young  men  to 
enlist  in  the  military  service  as  opposed  to  taking  jobs  or 
continuing  their  education.   The  study  covered  a  span  of  four 
years,  1966-1970,  for  a  sample  of  2213  young  men.   The  study 
tracked  them  beginning  in  the  early  tenth  grade  and  ending 
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one  year  after  most  of  the  group  had  graduated  from  high 
school . 

The  study  examined  the  enlistment  behavior  as  a  func- 
tion of  the  following  predictor  variables:   perceived  affinity 
for  service  life,  vocational  indecision,  draft  status,  race, 
geographical  region,  broken  home,  family  size,  parental 
punitiveness ,  social  class,  father's  military  experience, 
brother's  military  experience,  influence  of  others  (anticipated 
response  of  parents,  peers,  and  school  officials  to  the  possi- 
bility of  enlisting),  intelligence  test  score,  average  class- 
room grades,  attitudes  toward  school,  educational  attainment 
(dropping  out),  failing  a  grade  prior  to  high  school,  high 
school  curriculum,  attitudes  toward  Vietnam  war,  area  unemploy- 
ment, and  area  wages. 

It  was  found  that  one  combination  variable,  twelfth 
grade  plans  to  enlist  plus  certainty  of  plans,  contributed 
more  to  the  prediction  of  enlistment  than  all  other  variables 
combined.   It  was  concluded  that,  in  fact,  there  is  no  single 
"military  type."   This  meant  that  enlistees  were  not  character- 
ized by  an  particular  profile  of  background,  ability,  or 
personality  which  clearly  set  them  apart  from  other  young  men 

their  age. 

In  1974  Fisher  and  DiSario  /~Ref .  lj   examined  the 
results  of  a  national  survey  conducted  in  November  1972  aimed 
at  studying  the  enlistment  motivation  of  American  youth  as 
well  as  their  attitudes  towards  military  service.   The  sample 
size  was  1,924-  male  youths  aged  16  to  21.   Among  high  school 
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graduates  in  the  sample,  50%   expressed  a  negative  attitude 
toward  enlisting  for  military  service.   Considerable  enlist- 
ment influence  was  attributed  to  having  been  in  personal  contact 
with  a  recruiter.   Information  provided  by  the  recruiter  had 
more  influence  on  an  enlistment  decision  than  did  television 
or  other  media.   The  majority  of  youth  reported  recruiter 
contact  at  some  time.   The  preceding  facts  imply  that  it  is 
very  important  in  obtaining  recruits  to  make  personal  contact 
due  to  the  strong  influence  this  has  on  youth. 

In  197^  Fisher  and  Harford  /~Ref .  8_7  examined  the 
number  of  enlistees  for  each  military  service  who  were  con- 
verted from  those  initially  applying  to  that  service.   In  the 
case  of  conversion  of  initial  Marine  Corps  applicants  to  Marine 
Corps  enlistees  the  12  potential  predictor  variables  studied 
were  as  follows:   perception  of  career  opportunities,  maturity, 
travel,  advanced  education,  choice  of  service,  age,  race, 
Armed  Forces  Qualification  Test  (AFQT)  category,  influence 
of  relatives,  influence  of  publications,  influence  of  posters, 
and  influence  of  movies.   The  survey  data  was  compiled  in 
fiscal  year  1972  from  a  sample  of  25  Armed  Forces  Entrance 
and  Examining  Stations  (AFEES)  nationwide.   A  total  of  25,878 
enlistees  in  all  branches  of  the  service  was  questioned  during 
routine  entrance  processing.   Fisher  and  Harford  found  that 
the  following  variables  influenced,  in  descending  order, 
the  Marine  Corps  applicant:   age,  influence  of  relative  endorsing 
choice  of  service,  enlisting  for  career  opportunities,  influ- 
ential media,  AFQT  category,  and  race.   The  implication  was 
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that  the  Marine  Corps  appealed  to  the  younger  applicant  who 
received  positive  support  from  relatives  in  deciding  to  enlist. 
The  applicant  was  also  influenced  by  movies,  posters,  and 
military  publications.   He  tended  to  be  in  AFQT  mental  groups 
I  and  II  and  Caucasian. 

In  1973.  Caroll  and  Jehn  /~Ref.  9_7  examined  how  the 
supply  of  Navy  enlistments  depended  on  pay,  unemployment,  and 
policy  variables  such  as  the  number  of  recruiters  and  adver- 
tising expenditures.   They  used  productivity  data  for  the 
entire  Navy  recruiting  force  during  the  period  January  1970 
through  August  1972.   They  found  that  the  measured  effect  of 
pay  and  advertising  was  generally  statistically  insignificant. 
On  the  other  hand,  in  all  cases  the  effect  of  recruiters  was 
so  high  as  to  be  hard  to  believe,  according  to  Caroll  and 
Jehn.   The  reasons  cited  for  these  results  were  the  high 
correlations  of  each  variable  with  the  others  thus  causing 
multicollinearity  in  the  model.   They  were  unable  to  tell 
which  of  these  independent  variables  --  increases  in  military 
pay,  numbers  of  recruiters,  and  advertising  expenditures  -- 
caused  increases  in  enlistments  during  the  period  productivity 
was  being  studied. 

k.      Studies  Published  in  1975 

In  1975  Grissmer,  Lanigan,  Scuder,  Goldberg,  Peterson, 
and  Sterrett  /~Ref .  11_7  provided  a  plan  of  action  for  an 
analysis  of  factors  which  might  affect  recruiter  productivity. 
They  proposed  a  model  to  study  the  propensity  of  the  market- 
place to  enlist  in  the  Army.   Their  model  examined  the  supply 
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of  contracts  per  QMA  as  a  function  of  recruiters  and  canvassers 
per  QMA,  military  pay  relative  to  fulltime  civilian  pay  adjusted 
for  unemployment,  negative  attitudes  toward  the  military, 
unemployment  rates,  percentage  of  QMAs  enrolled  in  college, 
other  services'  recruiters  plus  recruiter  assistants  per  QMA, 
advertising  contacts  per  QMA,  and  eight  variables  representing 
the  effects  of  various  recruiting  policies  and  enlistment 
options.   The  model  was  proposed  after  the  researchers  concluded 
that  the  current  methodology  for  arriving  at  the  QMA  market 
caused  a  significantly  increasing  error  as  the  time  moved  away 
from  the  1970  Census  population  base.   They  also  stated  that 
actual  field  experience  had  shown  that  a  high  QMA  market  does 
not  necessarily  result  in  a  high  enlistment  rate  because  of 
varying  influences  which  motivate  individuals  to  enlist. 
(There  is  no  statistical  basis  cited  for  this  "actual  experi- 
ence" . )   This  reference'  provides  a  useful  guide  for  a  large 
scale  approach  to  examining  the  propensity  of  the  marketplace 
to  yield  recruits. 

In  1975,  Brown,  Wood,  and  Harris  /~Ref.  12_7  examined 
the  total  number  of  Army  accessions  as  a  function  of:   average 
production  per  recruiter  in  subject's  district  recruiting 
command  (DRC) ,  average  market  share  for  station  zone,  propor- 
tion of  zone  which  is  suburban,  months  of  experience  as  a 
recruiter,  number  of  high  school  seniors  in  zone,  average 
production  per  recruiter  for  subject's  regional  recruiting 
command  (RCC) ,  the  degree  of  Armed  Services  Vocational  Aptitude 
Battery  testing  saturation  in  subject's  DRC,  number  of  17-21 
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years-olds  in  college  in  station  zone,  size  of  station  zone 
in  square  miles,  proportion  of  zone  which  is  rural,  proportion 
of  zone  which  is  metropolitan,  and  the  ratio  of  QMA  to  MA 
(the  total  male  population  aged  17-21  in  a  particular  terri- 
tory) .   The  sample  consisted  of  500  recruiters  from  the  nation 
as  a  whole.   The  sample  pulled  100  recruiters  randomly  from 
each  of  the  five  Army  Regional  Recruiting  Commands  (RCCs) . 
The  data  covered  the  period  from  July  to  December  1973* 

The  best  single  predictor  they  found  was  "average 
production  per  recruiter  in  the  subject's  district  recruiting 
command."   This  variable  alone  accounted  for  k8%   of  the  variance 
in  production  scores.   This  implied  that  district  or  terri- 
torial productivity  was  strongly  influenced  by  the  charac- 
teristics of  the  district  which  could  be  social  or  cultural 
features  not  measured  in  the  study.   Further,  they  concluded 
that  it  was  possible  that  "average  production  per  recruiter 
in  the  DRC"  was  itself  a  function  of  local  personnel  manage- 
ment practices  and  of  the  quality  of  the  individual  recruiters. 

C.   THE  CRITERION  PR0BI£M 

There  is  a  need  to  develop  some  measure  of  recruiter 
effectiveness.   Currently  the  attainment  of  the  assigned 
recruiting  quota  is  the  accepted  measure.   It  is  questionable 
whether  raw  production  figures  in  themselves  are  adequate 
to  compare  the  effectiveness  of  different  recruiters.   The 
simplicity  of  using  attainment  of  quota  to  measure  effective- 
ness makes  it  convenient  to  do  so.   But,  it  needs  to  be 
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determined  if  a  rational  basis  for  assigning  quota  is  "being 
applied  before  this  simple  measure  is  used.   Does  the  recruiter 
in  the  rural  area,  where  he  spends  a  good  deal  of  time  travel- 
ing, have  the  same  opportunities  to  recruit  his  quota  as  the 
recruiter  in  a  large  city  or  suburban  area?   Can  there  be  any 
standard  method  to  categorize  high  schools  in  a  given  recruit- 
ing territory  so  that  a  propensity  to  produce  recruits  can  be 
uniformly  assessed? 

The  aim  of  this  study  was  to  develop  a  criterion  for 
measuring  recruiting  performance  based  on  the  characteristics 
of  the  territory  being  recruited  from. 

D.   OVERALL  STUDY  FLAN 

This  study  plan  required  productivity  data  on  California- 
based  Marine  Corps  recruiters  for  fiscal  year  1975  and  data 
pertaining  to  the  California  Public  School  System  for  school 
year  1973-7^-   Once  collected,  the  productivity  data  of  the 
recruiters  was  to  be  matched  with  the  data  describing  the 
school  district(s)  covered  by  the  recruiters.   Next,  a  sta- 
tistical analysis  was  to  be  attempted  to  identify  those  fac- 
tors outside  of  the  recruiter's  control  (school  district 
variables)  that  accounted  for  variance  in  territorial  produc- 
tivity. 

A  multiple  regression  equation  was  to  be  developed  and 
used  to  predict  total  productivity  of  each  territory.   This 
predicted  productivty  would  represent  the  production  that  a 
recruiter  of  average  ability  could  be  expected  to  attain  in 
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that  territory.   This  would  be  the  criterion  for  measuring 
actual  performance  in  that  territory. 

This  study  was  to  differ  from  previous  studies  in  that  it 
would  examine  the  recruiter's  territory  strictly  from  the 
qualities  of  the  public  school  system.   This  was  deemed  appro- 
priate in  light  of  the  renewed  emphasis  given  to  obtaining 
high  school  graduates  by  the  Commandant  of  the  Marine  Corps 
/~Ref.  1_7. 
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II.   DEVELOPMENT  OF  A  CRITERION  OF 
RECRUITING  EFFECTIVENESS 


A.  INTRODUCTION 

The  popular  measure  of  recruiter  effectiveness  has  been 
the  percentage  of  objective  achieved.   But,  it  does  not  pro- 
vide an  indication  of  the  territory  the  recruiter  has  to  work 
with.   The  questions  which  need  to  be  answered  are:   (1)   How 
can  the  recruiter's  territory  be  evaluated  and  (2)   how  should 
quotas  for  enlistment  be  assigned  based  on  the  recruiter's 
territory? 

This  study  attempted  to  deal  with  these  questions.   First, 
it  was  assumed  that  the  recruiter's  territory  could  be  des- 
cribed in  terms  of  the  characteristics  of  public  high  schools 
in  a  recruiter's  territory.   The  use  of  multiple  regression, 
it  was  hoped,  would  be  useful  in  predicting  productivity  of 
an  area  based  on  these  school  characteristics.   The  answer 
to  the  second  question  would  be  a  simple  matter  of  equalizing 
the  distribution  of  recruiters  based  on  the  dominant  predictor 
variables  found  in  the  multiple  regression  formula/equation. 

B.  LIST  OF  POTENTIAL  PREDICTORS  OF  TERRITORY  PRODUCTIVITY 

The  variables  chosen  for  this  study  and  the  rationale  for 
including  them  are  described  in  the  following  paragraphs. 
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1.  Enrollment  in  Grades  10-12  f ENROL  1 

This  variable  represents  total  enrollment  in  the 
school  district.   It  is  a  measure  of  the  recruitable  popu- 
lation in  the  district  over  the  coming  two  years  when  the 
recruiter  can  take  them  as  graduates. 

2.  Male  High  School  Graduates  (GRADM) 

This  variable  represents  the  number  of  male  high  school 
graduates  in  each  school  district.   It  was  included  because  of 
the  increasing  emphasis  on  getting  high  school  graduates  to 
enlist. 

3'      Male  General  Work  Experience  (GWRKM) 

The  California  Public  School  System  permits  students 
to  substitute  actual  work  experience  for  some  of  their  class- 
room work.   This  variable  represents  the  number  of  students 
per  district  which  are  participating  in  the  general  work 
experience  program- -males  only. 

k.      Male  Vocational  Education  Program  Enrollment  (VOCEDM) 

This  variable  represents  the  number  of  male  students 

enrolled  in  a  vocational  education  program.   Such  students 

were  believed  to  be  more  favorably  inclined  to  enlist  than 

a  student  following  a  college  preparatory  course  of  study. 

5 .   Minority  Male  Vocational  Education  Program  Enroll- 
ment (v'ocmmT 

This  variable  represents  the  number  of  minority  male 
students  enrolled  in  a  vocational  education  program  per  dis- 
trict.  It  was  thought  that  these  students  would  have  a  high 
propensity  to  enlist  because  of  the  opportunity  to  further 
vocational  skills. 
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6.  Average  Daily  Attendance  for  Second  Period  1973-7M  ADA2) 
This  variable  represents  a  planning  base  and  authori- 
zation figure  for  which  school  districts  receive  State  financial 
support.   It  was  believed  that  a  large  value  for  ADA2  would  be 
an  indicator  of  a  large  student  population.   It  would  compen- 
sate for  not  considering  the  ninth  grade  students  in  the 

ENROL  variable  described  earlier. 

7.  Modified  Assessed  Valuation  Per  Unit  of  ADA2  (ASSVAL) 
This  variable  represents  the  assessed  property  values 

on  which  the  school  district  tax  base  is  built.   The  ability 
of  a  school  district  to  provide  local  revenues  can  be  measured 
by  the  amount  of  assessed  valuation  that  exists  for  each  unit 
of  average  daily  attendance.   This  variable  was  included 
because  it  gives  a  measure  of  economic  wealth  in  the  district. 

8.  Public  Law  81-87^  Income  (FEDIN1) 

This  variable  represents  Federal  reimbursement  to  school 
districts  for  the  loss  of  taxable  base  which  occurs  when  students 
attending  schools  in  the  district  reside  on  Federal  property. 
The  inclusion  of  this  variable  in  the  model  enabled  it  to 
consider  the  impact  of  proximity  to  a  military  reservation  on 
productivity. 

9.  Total  Federal  Income  (FEDIN2) 

This  variable  represents  the  total  federal  income 
received  by  the  school  district.   Federal  revenues  are  largely 
directed  to  categorical  use  in  support  of  specific  programs. 
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10.   Total  Current  Expense  of  Education  -  Administration 
(CUREXP)  "" 

This  variable  represents  total  current  expenditures 
of  the  school  district  to  support  its  educational  programs. 
A  portion  of  this  is  dedicated  to  pupil  transportation  costs. 
This  variable  was  included  to  see  what  proportion  of  a  dis- 
trict's total  current  expenditure  was  attributed  to  transport- 
ing 'students .   Thus  it  would  measure  the  relative  rural  nature 
of  the  district. 

11.  Pupil  Transportation  Expenditures  (PUTRANS) 

This  variable  represents  the  expense  of  transporting 
students.   It  was  chosen  as  a  rough  measure  of  student  disper- 
sion in  the  school  district.   Thus  it  should  indicate  the  need 
for  a  recruiter  to  travel  in  order  to  contact  the  students  at 
home  in  a  given  district. 

12.  Percent  of  Income  from  Local  Sources  (PLOCIN) 

This  variable  represents  the  percent  of  income  derived 
from  local  sources  for  a  school  district.   It  was  chosen  to  be 
an  indicator  of  economic  wealth.   A  high  percent  of  income 
derived  from  local  taxes  would  indicate  a  wealthy  district. 

13.  Average  High  School  Teacher's  Salary  (TCHSAL) 
This  variable  represents  the  average  high  school 

teacher's  salary  in  a  school  district.   It  was  included  as 
a  surrogate  for  local  income  level.   It  was  reasoned  that  the 
average  high  school  teacher's  salary  would  rise  with  the  rising 
wealth  of  a  district. 
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14.   Number  of  Recruiters  Assigned  Per  RSS  (NRCTRS) 

This  variable  represents  the  number  of  Marine  Corps 
recruiters  assigned  per  recruiting  substation  (RSS).   Rosters 
of  the  12th  Marine  Corps  District  were  consulted  for  recruiter 
names  which  were  then  cross  referenced  to  the  CMC  Net  Produc- 
tivity Report.   There  were  some  instances  when  a  recruiter's 
name  could  not  be  located  on  the  CMC  report.   In  that  case  the 
value  was  assigned  a  missing  values  code  of  -1  for  the  variable 
Another  shortcoming  of  this  variable  was  that  the  recruiters 
on  the  CMC  report  were  carried  thereon  for  one  year  after 
leaving  recruiting  duty.   Thus,  recruiters  were  implicitly 
assigned  for  an  entire  year  for  this  study  which  causes  this 
variable  to  be  inflated  in  some  instances.   Despite  the  weak- 
nesses inherent  to  this  variable  it  was  used  because  the 
cumulative  productivity  figures  on  the  CMC  report  were  related 
to  NRCTRS. 

15.   Man-Months  of  Recruiters  Assigned  (MMRCTR) 

This  variable  represents  the  number  of  recruiters 
assigned  to  each  recruiting  substation  (RSS)  per  month  during 
fiscal  year  1975.   The  values  came  from  12th  Marine  Corps 
District  files.   For  example,  3  recruiters  if  assigned  to  a 
given  RSS  for  the  entire  year  would  give  a  value  of  36  man- 
months  of  recruiters.   This  variable  was  chosen  because  it 
gave  a  good  indication  of  the  amount  of  recruiting  effort 
the  Marine  Corps  was  applying  to  different  areas . 
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C.   OBTAINING  A  SAMPLE  OF  RECRUITER  TERRITORIES 

In  formulating  the  research  plan  it  was  decided  to  restrict 
the  study  to  the  State  of  California.   California  was,  due  to 
its  geographic  size  and  diversity,  thought  to  be  representative 
of  the  various  areas  that  the  recruiters  are  working  in  nation 
wide.   This  does  not  mean  that  the  regional  attitudes  of  the 
West  coast  are  comparable  or  similar  to  those  on  the  East  Coast. 
It  simply  means  the  population  dispersion  and  the  effects  this 
dispersion  has  on  a  recruiter  could  be  compared.   Another 
reason  that  the  study  was  limited  to  California  was  the  ease 
and  minimal  cost  with  which  data  on  the  public  school  system 
could  be  collected. 

The  Director,  12th  Marine  Corps  District,  has  jurisdiction 
over  the  Marine  Corps  recruiters  operating  in  California. 
The  cooperation  of  his  staff  made  the  collection  of  produc- 
tivity data  possible.   Data  on  the  productivity  of  179  Marine 
recruiters  assigned  to  66   recruiting  substations  (RSS)  in 
California  was  collected  for  fiscal  year  1975- 

Data  describing  the  California  Public  School  System  was 
obtained  from  the  State  Board  of  Education.   Financial  data 
was  aggregated  by  school  district.   Enrollment  data  was 
collected  by  individual  schools.   In  order  to  maintain  a 
common  data  base  the  enrollment  data  was  aggregated  by  school 
district  also.   There  did  not  appear  to  be  a  way  to  disaggregate 
the  financial  data  from  district  level  to  school  level. 
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D.   DEFICIENCIES  IN  THE  TERRITORIAL  INFORMATION 

Ideally,  each  item  descriptive  of  the  recruiter's  territory 
should  be  confined  to  the  specific  territory  he  covers .   The 
lowest  level  of  aggregation  in  the  public  school  system  was, 
commonly,  at  the  school  district  level.   Since  a  recruiter 
segments  his  territory  by  individual  high  schools,  the  school 
district  level  of  aggregation  is  not  appropriate  to  define  his 
territory.   Several  recruiters  may,  in  fact,  cover  a  single 
school  district. 

The  productivity  data  did  not  cover  the  identical  period 
that  educational  data  covered.   Productivity  figures  were 
available  for  fiscal  year  1975  (1  July  197^  -  30  June  1975). 
Enrollment  and  financial  data  on  the  school  districts  were 
available  for  school  year  1973-7^  (September  1973  -  June  197*0. 
This  is  a  weakness  in  the  study  which  could  be  overcome  by 
obtaining  productivity  and  school  data  for  the  same  period. 
It  was  not  considered  too  erroneous  to  proceed  on  the  basis 
of  available  data  because  it  did  not  seem  likely  that  signi- 
ficant changes  would  have  occurred  in  the  relative  standing  of 
school  districts  in  one  year's  time.   Population  shifts  would 
affect  the  school  data.   Time  and  cost  considerations  prevented 
further  data  collection. 

Private  schools  were  omitted  from  the  study  mainly  because 
insufficient  data  was  available.   They  appear  to  be  more  numerous 
in  the  urban  areas  of  California.   Because  of  the  family  income 
level  necessary  to  send  children  to  private  high  schools  the 
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effect  of  having  a  private  high  school  in  a  recruiters'  terri- 
tory may  be  partly  captured  by  the  assessed  valuation  variable 
(ASSVAL) .   The  study  would  have  been  more  complete  if  private 
schools  had  been  included  in  the  data  base. 

E.  EXPLANATION  FOR  AGGREGATING  RECRUITING  SUBSTATIONS 

In  order  to  map  the  productivity  of  Marine  Corps  recruiters 
on  the  school  district  data  base  it  was  first  necessary  to  group 
recruiters  by  their  RSS  assignment.   The  attempt  to  map  produc- 
tivity of  actual  RSSs  was  prevented  because  RSS  territorial 
boundaries  were  not  coincident  with  the  school  district 
boundaries.   Certain  school  districts  were  so  large  that  they 
received  coverage  from  more  than  one  RSS.   This  was  very  evi- 
dent in  the  Los  Angeles  area.   More  often  it  was  the  case  where 
one  RSS  covered  more  than  one  school  district  and  overlapped 
with  other  RSS  coverages.   The  method  chosen  for  eliminating 
duplicative  coverages  and  overlaps  was  to  aggregate  recruiting 
substations  (RSSs)  until  one  aggregated  RSS  covered  a  unique 
subset  of  the  school  districts.   The  result  of  doing  this  was 
that  no  longer  could  "recruiter"  productivity  be  assessed. 
Instead  the  study  could  only  address  "recruiting"  effectiveness 
as  it  pertained  to  these  aggregated  RSSs. 

F.  COMPOSITION  OF  SCHOOL  DISTRICTS 

In  the  1973-7^  school  year  approximately  two-thirds  of 
the  average  daily  attendance  in  California's  public  elementary 
and  secondary  schools  was  registered  in  251  unified  school 
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districts.   The  803  individual  elementary  and  high  school 
districts  served  the  remaining  one-third  of  the  students 
comprising  the  total  state  average  daily  attendance.   Approxi- 
mately 53%   of  these  803  districts  operated  a  single  school. 

G.   COMPOSITION  OF  SCHOOLS 

According  to  the  State  Board  of  Education  few  California 
school  districts  can  maintain  a  consistent  pattern  of  grades 
in  all  of  the  elementary  or  secondary  schools  they  operate 
because  of  obsolete  buildings  or  population  shifts  within 
the  districts.   Typically,  secondary  schools  are  junior  high 
schools,  senior  high  schools  having  grades  10-12,  or  high 
schools  having  grades  9-12.   In  this  study  the  enrollment 
figures  were  used  for  grades  10-12  as  being  the  least  common 
denominator  for  the  data  base. 

H.   NORMALIZATION  OF  SCHOOL  DISTRICT  FINANCIAL  VARIABLES 

It  was  necessary  to  distinguish  between  unified  and  high 
school  district  types  when  dealing  with  financial  variables 
for  these  districts  (ADA2,  ASSVAL,  PLOCIN,  FEDIN1,  FEDIN2, 
FUTRANS,  CUREXP,  and  TCHSAL) .   The  reason  for  separately 
evaluating  these  variables  by  type  of  district  was  due  to 
the  different  financial  base  used.   Unified  districts  incor- 
porated elementary  and  secondary  school  students  in  their 
bases.   High  school  districts  relied  only  on  high  school 
students  for  their  bases.   Because  it  was  common  to  see  both 
district  types  being  covered  by  an  RSS  it  was  necessary  to 
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standardize  these  variables  in  order  to  aggregate  financial 
data  of  various  districts  to  map  onto  their  respective  RSS . 
Standardization  was  done  by  a  Z-score  transformation.   The 

X-X 
formula  used  was  Z  =  where  X  equals  the  value  of  the 

SD 
variable  being  normalized,  X  equals  the  mean  value  of  that 

variable,  and  SD  equals  the  standard  deviation  of  that  variable. 

The  financial  variables  were  thus  transformed  and  relabeled 

(ZADA2,  ZASSVAL,  ZPLOCIN,  ZFEDIN1,  ZFEDIN2,  ZPUTRANS,  ZCUREXP, 

and  ZTCHSA1) . 

I.   DESCRIPTION  OF  RECRUITER  PRODUCTIVITY  VARIABLES 

There  were  two  separate  variables  used  to  represent  produc- 
tivity.  The  variable  chosen  to  represent,  productivity  for 
one  model  was  labeled  CONCMC .   CONCMC  values  came  from  the 
CMC  Recruiter  Net  Productivity  Report.   The  variable  repres- 
enting productivity  for  the  other  model  was  labelled  C0N12. 
C0N12  values  came  from  the  12th  Marine  Corps  District  records 
for  FY-75.   Both  of  these  variables  were  measured  in  terms  of 
total  contracts  for  enlistment  obtained  by  each  aggregated 
RSS. 

J.   MAPPING  SCHOOL  DISTRICTS  ON  RECRUITING  SUBSTATIONS 

Productivity  variables  were  arranged  initially  on  ^2  RSS 
cases  (each  case  representing  one  aggregated  RSS)  .   These 
cases  were  then  made  into  ^2  subfiles  of  an  SPSS  (Statistical 
Package  for  the  Social  Sciences)  system  file. 
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School  district  variables  were  initially  arranged  on  36^ 
cases  (1  case  per  school  district).   The  appropriate  RSS  code 
was  punched  on  each  school  district  case.   These  "}6k   cases 
were  sorted  by  RSS  code  and  aggregated  statistics  were  com- 
puted for  each  aggregation  of  school  districts.   These  aggre- 
gated school  district  cases  were  saved  on  another  SPSS  system 
file.   The  aggregated  mean  was  used  to  represent  the  value  of 
each  variable  for  the  aggregated  case.   The  k2   aggregated 
school  district  cases  were  then  arranged  in  the  same  sequence 
as  the  aggregated  RSS  cases  in  the  productivity  file.   Next, 
the  cases  of  the  school  district  file  were  merged  with  the 
cases  of  the  RSS  productivity  file.   This  mapping  of  school 
districts  on  recruiting  substations  enabled  subsequent  sta- 
tistical analysis  of  the  predictor  variables  of  the  school 
district  with  the  dependent  variable  of  productivity  (either 
CONCMC  or  C0N12)  for  the  aggregated  RSS. 

K.   HANDLING  OF  MISSING  DATA  PERTAINING  TO  NRCTRS 

A  missing  values  code  of  (-1)  was  used  for  the  variable 
NRCTRS  when  the  recruiter  productivity  file  was  constructed. 
Recruiters  carried  on  the  roster  of  12th  MCD  for  FY-75  were 
not  all  found  on  the  CMC  Net  Productivity  report.   When  this 
occurred  it  was  assumed  that  the  12th  MCD  data  was  more 
accurate  than  that  of  its  higher  headquarters.   Therefore, 
some  RSSs  had  a  missing  values  code  assigned  when  a  recruiter's 
name  did  not  appear  on  the  CMC  report.   In  the  aggregation  of 
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RSSs  this  meant  that  there  was  missing  data.   Fortunately, 
this  resulted  in  only  8  of  ^2  RSSs  (aggregated  RSSs)  showing 
missing  values  for  the  variable  NRCTRS. 

The  SPSS  system  of  computer  programs  enables  the  user 
to  specify  missing  values  for  each  of  the  variables  so  that 
cases  with  incomplete  data  may  still  be  conveniently  processed. 
In  this  study  the  SPSS  programs  were  instructed  to  omit  cases 
entirely  which  had  the  missing  values  code. 

L.   CREATION  OF  ANALYSIS  AND  CROSS-VALIDATION  SAMPLES 

In  order  to  test  the  accuracy  of  the  model  produced  by  this 
study,  in  predicting  productivity,  a  reduced  sample  size  was 
used  for  purposes  of  analysis.   A  random  sample  of  29  aggre- 
gated RSSs  was  selected  from  the  original  sample  for  data 
analysis.   There  were  6  of  the  29  which  had  missing  values  for 
the  NRCTRS  variable.   This  caused  a  further  reduction  in  sample 
size  to  23  cases  or  aggregated  RSSs.   The  remaining  13  cases 
were  used  to  cross  validate  the  results  of  the  study  by  compar- 
ing the  productivities  predicted  by  the  model  for  these  cases 
with  the  actual  values. 
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III.   DEVELOPMENT  OF  MODELS  PREDICTING 
PRODUCTIVITY  AND  RECRUITING  EFFORT 


A.   INTRODUCTION 


The  first  two  models  in  the  study  were  developed  to  pre- 
dict productivity,  either  CONCMC  or  C0N12,  using  the  predictor 
variables  descriptive  of  the  school  districts.   In  each  of 
these  models  the  variable  representing  recruiting  effort 
(NRCTRS  in  CONCMC  model  and  MMRCTR  in  C0N12  model)  were  ini- 
tially omitted  from  the  model  as  predictors.   This  gave  a 
representation  of  the  effects  on  productivity  of  just  the 
school  district  variables.   In  other  words,  an  effort  was 
made  to  examine  productivity  only  as  a  function  of  those 
variables  beyond  Marine  Corps  controllability.   A  subsequent 
analysis  was  then  made  of  each  model  with  the  recruiting 
effort  variable  included  as  a  predictor. 

The  next  modeling  procedure  used  a  composite  variable 
representing  productivity.   Specifically,  the  productivity 
variable  for  the  CONCMC  model  (CONCMC)  was  divided  by  the 
recruiting  effort  variable  (NRCTRS) .   This  gave  a  produc- 
tivity variable  normalized  for  recruiting  effort  and  labeled 
CONCADJ.   The  predictive  qualities  of  this  model  were  evaluated 
A  similar  procedure  was  followed  with  the  C0N12  model.   A 
productivity  variable  normalized  for  recruiting  effort 
(C0N12AJ)  was  formed  by  dividing  C0N12  by  MMRCTR. 
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Finally,  an  attempt  was  made  to  model  the  recruiting  effort 
variables  (NRCTRS  and  MMRCTR)  as  a  function  of  the  school  dis- 
trict variables.   The  predictive  qualities  of  these  two  models 
were  then  evaluated. 

B.   PRODUCTIVITY  AS  A  FUNCTION  OF  THE  PREDICTOR  VARIABLES 

In  order  to  predict  productivity,  as  shown  by  total  con- 
tracts (CONCMC  or  C0N12) ,  it  was  first  necessary  to  examine 
the  relationships  between  the  predictor  variables  and  in 
turn  their  relation  to  the  dependent  variable  representing 
productivity  (CONCMC  or  C0N12) . 

1 .   Preliminary  Examination  of  Predictors  of  Productivity 
The  correlations  between  the  variables  used  in  this 
study  are  shown  in  Table  I . 


TABLE  I 

Pearson-Product-Moment  Correlation  Coefficients  of 
Predictor  Variables  with  Productivity  Variables 

(N=23) 


VARIABLE 

CONCMC 

C0N12 

NRCTRS 

MMRCTR 

ENROL 

GRADM 

GWRKM 

VOCEDM 

VOCMM 

ZASSVAL 

2FEDIN1 

ZFEDIN2 

ZADA2 

2CUREXP 

2PUTRANS 

ZPLOCIN 

ZTCHSAL 


CONCMC 

1.00000 
0.96421 

0.95913 
0.94774 

0.44393 
0.44380 
0.27752 
0.63474 

0.71575 
-O.06063 
O.25660 
0.64358 
0.61998 
0 .23206 
0.19639 
0 .00467 
0.08108 


C0N12 

0.96421 
1.00000 
0.98295 
0.99^31 
0.48119 
0.48434 
0 . 34450 
0.71355 
0.78305 
-0.01273 
0.32559 
0.73032 
0 .70215 

0.26672 
0.20776 
0 .10  641 
0.13628 
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The  Pearson  product-moment  correlation  coefficient, 
denoted  "by  r,  is  a  measure  of  association  indicating  the 
strength  of  the  linear  relationship  between  two  variables. 
When  the  value  of  r  approaches  +1.0  or  -1.0,  a  strong  linear 
relationship  is  indicated.   It  is  evident  from  Table  I  that 
a  strong  positive  correlation  exists  between  productivity 
(number  of  contracts  —  either  CONCMC  or  C0N12)  and  other  vari- 
ables.  The  strongest  correlations  (above  0.6)  are  shown 
below: 

Variables  r 

CONCMC  with  C0N12  0.96^21 

CONCMC  with  NRCTRS  0.95913 

CONCMC  with  MMRCTR  0.9^77^ 

CONCMC  with  V0CMM  0.71575 

CONCMC  with  ZADA2  0.61998 

C0N12  with  NRCTRS  0.98295 

C0N12  with  MMRCTR  0.99^31 

C0N12  with  V0CEDM  0.71355 

C0N12  with  V0CMM  0.78305 

C0N12  with  ZFEDIN2  0.73032 

C0N12  with  ZADA2  0.70215 

These  correlations  imply  that  the  number  of  contracts 
is  affected  by  the  number  of  recruiters,  the  number  of  man- 
months  of  recruiting  effort,  the  number  of  vocational  minority 
male  students,  the  number  of  vocational  education  male  students, 
the  total  federal  income  (normalized)  of  the  district  and  the 
average  daily  attendance  (normalized)  in  the  district.   The 
relationships  between  the  number  of  contracts  and  the  number 
of  recruiters  and  the  number  of  recruiter  man-months  is 
expectedly  obvious.   The  more  recruiters  in  the  field  the 
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more  contracts  should  be  expected  in  total.   The  more  inter- 
esting relationships  are  those  concerning  the  number  of  con- 
tracts with  vocational  enrollments,  average  daily  attendance 
and  total  federal  income  in  the  school  districts.   These  latter 
relationships  suggest  that  the  greater  the  vocational  enroll- 
ments and  average  daily  attendance  and  federal  income  the 
easier  it  is  to  recruit.   However,  due  to  the  confounding  that 
exists  among  the  many  predictors  such  possible  relationships 
must  be  looked  at  more  closely.   This  is  done  in  the  next 
section. 

2.   Modeling  Productivity  as  a  Function  of  the  Predictors 
Because  of  the  suggested  relationships  discussed  in 
the  previous  section,  an  attempt  was  made  to  model  CON CMC  as 
a  linear  function  of  the  12  predictor  variables  excluding 
NRCTRS.   Excluding  NRCTRS  permitted  focusing  on  those  variables 
which  were  outside  the  control  of  the  Marine  Corps.   NRCTRS 
was  subsequently  included  in  a  later  analysis  of  the  predictor 
variables  on  CONCMC.   This  analysis  is  discussed  in  the  next 

section . 

A  multiple  stepwise  linear  regression  with  CONCMC  as 
the  dependent  variable  representing  recruiting  productivity 
was  performed.   The  results  are  shown  in  Table  II. 

The  predictor  variables  are  arranged  in  descending 
order  of  their  contribution  to  accounting  for  productivity 
(CONCMC).   The  best  single  predictor  is  VOCMM  representing 
vocational  minority  male  enrollment.   Table  II  shows  the 
correlation  coefficient  as  0.71575.   Table  II  also  shows 
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TABLE  II 


Multiple  Stepwise  Regression  of  CONCMC  with  1.2  Predictor 
Variables- -NRCTRS  Excluded 
(N=23) 


VARIABLE 

VOCMM 

GWRKM 

GRADM 

ZTCHSAL 

ZCUREXP 

ZFEDIN1 

VOCEDM 

ZASSVAL 

ZPUTRANS 

ZADA2 

ZPLOCIN 

ZFEDIN2 


MULTIPLE  R 
0.71575 

0 .  74456 

0.80316 
0.85130 
0.86897 
0.88883 
0.89448 
0.89811 

0.90007 
0.90206 

0.90299 
0.90397 


R   SQUARE 

0.51229 
0.55437 
0.64506 
0.72471 
0.755H 
0.79002 
0.80009 

0 .80660 

0.81012 
0.81371 
0.81538 
0.81716 


RSQ  CHANGE 

0.51229 
0.04208 
0.09069 
0.07965 
0.03041 
0.03491 

0  .01006 

0.00651 
0.00353 
0.00359 
0.00167 

0 .00178 


SIMPLE  R 

0.71575 
0.27752 
0.44380 
0.08108 
0.23206 

0 .25660 

0.63474 
■O.O6063 
0.19639 
0.61998 
0.00467 
0.64358 


that  VOCMM  accounts  for  approximately  51%    (R   equals  0.51229) 
of  the  variance  in  CONCMC.   That  is,  knowledge  of  the  voca- 
tional minority  male  enrollment  causes  a  reduction  in  varia- 
bility in  CONCMC  by  more  than  one-half.   Thus,  productivity 
is  strongly  influenced  by  the  vocational  minority  males  in 
California  high  schools. 

The  same  procedure  was  followed  using  C0N12  as  the 
productivity  variable  representing  the  total  contracts  for 
enlistment  as  shown  in  the  records  of  the  12th  Marine  Corps 
District  (FY-75).   The  results  of  the  multiple  stepwise  linear 
regression  with  C0N12  as  the  dependent  variable  and  excluding 
MMRCTR  are  shown  in  Table  III. 

The  predictor  variables  are  arranged  in  descending 
order  of  their  contribution  to  accounting  for  productivity 
(C0N12).   Table  III  shows  the  correlation  coefficient  as 
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TABLE  III 


Multiple  Stepwise  Regression  of  C0N12  with  12  Predict 
Variable S--MMRCTR  Excluded 
(N-23) 


or 


VARIABLE   MULTIPLE  R 


VOCMM 

2PL0CIN 

2TCHSAL 

ZADA2 

GWRKM 

GRADM 

ZCUREXP 

ZFEDIN1 

ZASSVAL 

ZPUTRANS 

ZFEDIN2 

VOCEDM 

ENROL 


0.78305 

0.83155 

0.85458 

0.88719 

0.89889 

0.91136 

0.93292 

0  .94400 

0.94817 

0.95081 

0.05164 

0.95200 

0.95216 


R  SQUARE 

0.61316 
0.69.48 
0.73030 
0.78711 
0.80800 
0.83058 
0.87033 
0.89114 

0.89903 
0.904o4 
0.90561 
O.90630 
0.90661 


RSQ  CHANGE 

0.61316 
0.07832 
0.03882 
0.05681 
0.02090 
0.02258 

0.03975 
0.02080 
0.00789 
0.00502 
0.00157 
O.OOO69 
0.00031 


SIMPLE  R 

0.78305 
0.10641 

O.I3628 
0.70  215 
O.34450 
0.48434 
0.26672 
0.32559 
-0.01273 
0.20776 
0.73032 

0.71355 
0.48119 


O.78305.   Table  III  also  shows  that  VOCMM  accounts  for  approxi- 
raately  6l%    (R  equals  0.61316)  of  the  variance  in  C0N12.   Thus, 
VOCMM  was  shown  to  be  the  best  single  predictor  for  productivity 
in  both  models  (CONCMC  and  C0N12) .   This  was  the  case  when  the 
variable  representing  recruiting  effort  was  removed  from 
consideration. 

Tables  II  and  III  also  show  that,  given  a  value  for 
VOCMM,  the  other  individual  variables  contributed  little 
additional  information  about  CONCMC  and  C0N12. 

3 .   Inclusion  of  Recruiting  Effort  as  an  Explanatory 

Variable 

The  analysis  of  section  2  was  repeated  with  NRCTRS 
included  among  the  predictor  variables.   The  results  of  the 
multiple  stepwise  linear  regression  with  CONCMC  as  the 
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dependent  variable  and  13  predictor  variables  including 
NRCTRS  are  shown  in  Table  IV. 


TABLE  IV 

Multiple  Stepwise  Regression  of  CONCMC  with  13  Predict 
Variables--NRCTRS  Included 
(N=23) 


or 


VARIABLE   MULTIPLE  R 


NRCTRS 

ZADA2 

ZPLOCIN 

ZTCHSAL 

ZPUTRANS 

ENROL 

ZCUREXP 

GRADM 

VOCMM 

ZFEDIN2 

ZFEDIN1 

VOCE DM 

GWRKM 

ZASSVAL 


0.95913 
0.97087 
0.9778^- 
0.98068 
0.98267 
0. 98518 
0.98673 
0.98790 
0.988^2 
O.98966 
0.99082 
0. 99085 
0.99091 
0.99092 


R  SQUARE 

0.91993 
0.9^258 

0.95617 
0.9617^ 
O.96563 

0.97057 
0.9736^ 
0.9759^ 
0.97697 
0.979^ 
0.98172 
0.98178 
0.98191 
0.98193 


RSQ  CHANGE 

0.91993 
0.02265 
0.01358 
0.00557 
0.00389 

0.00^+9^ 
0 .00307 

0.00230 
0.00103 
0.002^-7 
0.00228 
0.00006 
0.00013 
0.00002 


SIMPLE  R 

0.95913 
0.61998 
0.00^67 
0.08108 
O.I9639 
0.^4393 
0.23206 
0.44380 
0.71575 
0.6^358 
O.25660 
0.63^7^ 
0.27752 
■O.06063 


It  can  be  seen  in  Table  IV  that  the  number  of  recruiters 
assigned  per  RSS  (according  to  CMC  reports)  explains  96$  (R 
equals  0.95913)  of   the  variance  in  productivity--CONCMC .   Thus, 
all  other  variables  can  explain  an  additional  amount  of  Ufo   of 
the  variability  in  CONCMC.   Therefore,  in  order  to  predict 
CONCMC  with  considerable  accuracy,  the  number  of  recruiters 
is  all  that  is  needed. 

The  same  procedure  was  followed  with  C0N12  as  the 
dependent  variable  and  including  the  number  of  recruiter  man- 
months  per  RSS  (MMRCTR)  as  a  predictor  variable.   The  results 
are  shown  in  Table  V. 
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TABLE  V 


Multiple  Stepwise  Regression  of  C0N12  with  13  Predictor 
Variables --MMRCTR  Included 
(N=23) 


VARIABLE   MULTIPLE  R 


MMRCTR 

ZPLOCIN 

ENROL 

GWRKM 

2ADA2 

ZTCHSAL 

ZFEDIN1 

VOCMM 

ZASSVAL 

ZCUREXP 

VOCEDM 

ZPUTRANS 

ZFEDIN2 


0.99^31 
0.99530 

0.99637 
0.99694 

0.99715 
0.99801 
0.99815 
0.99821 

0.99823 
0.99824 
0.99826 
0.99826 
0.99826 


R  SQUARE 

0.98865 
0.99062 

0.99275 
0.99390 
0.99^30 
0.99603 
0.99630 
0.99641 
0.99646 
0.99649 
0.99652 

0.99653 
0.99653 


RSQ  CHANGE 

0.98865 
0.00197 
0.00213 
0.00115 
0.00041 

0.00173 
0.00027 
0.00011 

0.00005 
0.00003 
0.00003 
0.00001 
0.00000 


SIMPLE  R 

0.99431 
0.10641 

0.48119 

0 . 34450 

0.70  215 
0.13628 

0.32559 
0.78305 

■0.01273 
0.26672 

0.71355 
0.20776 
0.73032 


It  can  be  seen  in  Table  V  that  the  number  of  recruiters 

assigned  per  RSS  per  month  (according  to  12th  MCD  reports) 

2 

explains  99$  (R   equals  0. 98865)  of  the  variance  in  produc- 

tivity--C0Nl2.   Thus,  all  other  variables  explain  an  additional 
amount  of  a  little  more  than  1%   of  the  variability  in  C0N12. 
Therefore,  an  accurate  prediction  of  C0N12  can  be  made  knowing 
only  the  number  of  man-months  of  recruiter,  effort  being  assigned 
to  a  territory. 

The  remaining  variables  listed  in  Tables  IV  and  V  add 
insignificantly  to  the  predictive  power  of  their  respective 
model  (C0NCMC  or  C0N12)  as  is  shown  by  the  change  in  R  square 
(R2)  value  with  each  additional  variable  as  the  table  is 
scanned  from  too  to  bottom.   While  several  of  the  simple 
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correlations  between  productivity  and  the  other  variables  are 
greater  than  zero,  they  do  not  add  significantly  to  the  Multiple 
R  column  because  they  were  largely  duplicating  other  predictor 
variables  with  which  they  were  correlated.   As  an  example  of 
this,  Vocational  Minority  Male  enrollment  (VOCMM)  correlated 
0.71575  with  CONCMC  (refer  to  Table  I);  but,  because  it  also 
correlated  highly  (r  equals  0.83229)  with  Vocational  Education 
Male  Enrollment  (VOCEDM) ,  it  made  essentially  no  unique  contri- 
bution to  prediction  and  ranked  only  ninth  among  the  predictor 
variables  in  Table  IV  and  eighth  in  Table  V. 

k.      Normalizing  Production  by  Recruiting  Effort 

An  attempt  was  made  to  control  for  the  dominating  effect 
of  NRCTRS  on  CONCMC  and  MMRCTR  on  C0N12.   The  method  used  was 
to  divide  CONCMC  by  NRCTRS  and  likewise  C0N12  by  MMRCTR,  for 
each  of  the  23  cases  and  form  two  new  variables  as  a  result. 

Considering  first  the  CONCMC  model,  when  productivity 
(CONCMC)  was  divided  (normalized)  by  recruting  effort  (NRCTRS) 
the  new  variable  was  labeled  CONCADJ.   The  effect  of  this 
normalization  on  the  ability  of  the  predictor  variables  to 
predict  productivity  was  significant.   A  multiple  stepwise 
linear  regression  was  performed  with  CONCADJ  as  the  dependent 
variable  and  using  the  same  12  predictor  variables  as  before. 
The  results  of  this  regression  are  shown  in  Table  VI. 

The  predictor  variables  are  arranged  in  descending 
order  of  their  contribution  to  predicting  productivity--CONCADJ. 
The  first  (best)  predictor  to  enter  the  regression  was  GRADM 
representing  male  graduates.   Referring  to  Table  VI  it  is 


TABLE  VI 


Multiple  Stepwise  Regression  of  CONCADJ  with  12 
Predictor  Variables-- 
(N=23) 


VARIABLE   MULTIPLE  R 


GRADM 

GWRKM 

VOCMM 

2FEDIN2 

ZPLOCIN 

ZFEDIN1 

ENROL 

R2PUTRAN 

2ASSVAL 

2TCHSAL 

VOCEDM 

2ADA2 


0.26692 
0.32823 
0.35468 
0.44635 
0.^7905 
0.50488 
0.51917 
0.52687 
0.53658 
0.53802 
0.53960 
0.5^300 


R   SQUARE 

0.07125 
0.10774 
0.12580 
0.19923 
0.22949 

0 . 25490 

0.26953 
0.27760 
0.28792 
0.289^7 
0.29117 

0 . 29485 


RSQ  CHANGE 

0.07125 
0.03649 
0.01806 
0.0  73^3 
0.03027 
0.025^1 
0.01463 
O.OO806 

0.01033 
0.00154 

0.00170 
0.00368 


SIMPLE    R 

•0.26692 

0.01340 

•0.02815 

■0.22332 

0.14795 

■0.19378 

•0.26529 

0.03933 

0.12930 

■0.10193 

•0.04277 

•0.21261 


seen  that  GRADM  explained  only  7%   (R   equals  0.0  7125)  of  the 
variance  in  the  adjusted  productivity  variable- -CONCADJ .   The 
remaining  variables  added  only  slightly  to  the  predictive 
power  of  the  model.   The  amount  of  variation  explained  by  all 
12  predictor  variables  was  only  29^ 

The  meaning  of  these  results  is  that  RSS  productivity, 
on  the  average,  can  be  predicted  on  the  basis  of  NRCTRS . 
Because  the  productivity  is  based  on  aggregated  RSS  data  the 
model  does  not  permit  distinguishing  individual  recruiter 
productivity.   Apparently  recruiter  productivity  is  all  balanced 
out  at  the  RSS  level  towards  achieving  RSS  quota. 

The  C0N12  model  was  treated  in  a  similar  manner. 
Productivity  (C0N12)  was  divided  by  recruiting  effort  (MMRCTR) 
to  produce  a  new  productivity  variable- -C ON 12AJ .   Again,  the 


41 


effect  of  normalizing  the  dependent  productivity  variable 
affected  the  ability  of  the  predictor  variables  to  predict 
productivity.   The  results  are  shown  in  Table  VII. 


TABLE  VII 

Multiple  Stepwise  Regression  of  C0N12AJ  with  12 
Predictor  Variables 
(N=23) 


VARIABLE 

MULTIPLE 

R 

RSQ 

SIMPLE 

B 

R 

SQUARE 

CHANGE 

R 

ZASSVAL 

0.36997 

0.13687 

0.13687 

-0.36997 

0 

.06810 

GWRKM 

0.42005 

0.17644 

0.03957 

0.31208 

-0 

.00024 

2FEDIN2 

0.48189 

0.23222 

0.05578 

0.01290 

-0 

.26484 

VOCMM 

O.65036 

0.42297 

0.19075 

0.29143 

0 

.33307 

ZFEDIN1 

0.69152 

0.47820 

0.05523 

-0.01597 

0 

.08618 

VOCEDM 

0.73245 

0.536^9 

0.05829 

0.26242 

0 

.09661 

ZTCHSAL 

0.74642 

0.55715 

0.02066 

0.16897 

0 

•37542 

ENROL 

0.75882 

0.57581 

0.01866 

0.06343 

-0 

.03076 

ZPLOCIN 

O.76686 

0.58807 

0.01226 

-0.30018 

-0 

•35297 

GRADM 

0.77692 

O.6036I 

0.01554 

0.08341 

0, 

,20  244 

ZADA2 

0.77889 

O.60668 

0.00307 

0.05603 

-0, 

,03992 

RZPUTRAN 

0.77988 

0.60822 

0.00155 

0.02886 

0, 

,00434 

(CONSTANT) 

1, 

> 77937 

The  predictor  variables  are  arranged  in  descending 
order  of  their  contribution  to  predicting  productivity-- 
C0N12AJ.   The  first  predictor  to  enter  the  regression  (best 
predictor)  is  ZASSVAL  (normalized  assessed  valuation) .   ZASSVAL 
explains  14^  (R2  equals  O.I3687)  of  the  variation  in  the 

productivity  variable--C0N12AJ .   The  combined  effect  of  all 

2 
12  predictor  variables  in  the  model  explain  blfo   (R   equals 

0.60822)  of  the  variation  in  C0N12AJ. 
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The  "B-column"  in  Table  VII  is  a  listing  of  the  partial 
regression  coefficients  for  this  model.   The  last  value  in  the 
column  is  the  Y- intercept  or  "constant"  term.   To  derive  the 
mathematical  expression  of  the  C0N12AJ  model  it  is  merely 
necessary  to  multiply  each  variable  by  the  partial  regression 
coefficient  (e.g.  predicted  value  of  the  contribution  of  ZASSVAL 
equals  0.06810  x  ZASSVAL)  and  add  each  of  these  predicted  vari- 
ables to  the  constant  or  Y-intercept  to  obtain  the  linear  model. 
This  procedure  is  followed  in  a  later  section  of  this  study 
in  an  attempt  to  cross-validate  the  C0N12AJ  model. 

The  C0N12AJ  model  is  an  improvement  over  the  CONCADJ 
model.   This  can  be  seen  by  comparing  the  results  shown  in 
Table  VII  with  those  in  Table  VI.   The  amount  of  variation  in 
C0N12AJ  explained  by  the  predictors  is  6ofo .   The  amount  of 
variations  in  CONCADJ  explained  by  the  predictors  is  29$.   One 
important  reason  for  this  greater  explanatory  power  of  the 
C0N12AJ  model  is  that  the  variable  MMRCTR  has  much  greater 
range  than  NRCTRS  as  seen  below.   (The  below  statistics  were 
calculated  for  sample  size  N=23«) 

NRCTRS  MMRCTR 

Mean  5-3^8  59-690 

Variance  44.328  7201.1^8 

Range  31.000  442.000 

Std.  Dev.  6.658  8^.860 

Minimum  1.000  3. 000 

Maximum  32.000  445-000 

This  greater  range  permits  more  detailed  information  and  a 

more  definitive  analysis  of  the  effect  of  recruiter  effort. 

Because  C0N12AJ  or  C0N12  controlling  for  MMRCTR  has  greater 
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range  (there  are  less  ties)  and  is  more  "predictable"  it  does 
a  better  job  of  taking  recruiter  effort  out  of  productivity. 

C.   PREDICTING  RECRUITING  EFFORT  USING  SCHOOL  VARIABLES 

The  large  influence  of  recruiting  effort  on  productivity 
made  it  necessary  to  perform  a  multiple  stepwise  linear  regres- 
sion on  MMRCTR  using  the  school  variables  as  predictors  in  order 
to  determine  the  bases  for  assigning  recruiter  effort  to  an 
RSS.   Table  VIII  shows  the  results  of  this  regression. 


TABLE  VIII 

Multiple  Stepwise  Regression  of  MMRCTR  using  12 
Predictor  Variables 
(N=23) 


VARIABLE    MULTIPLE  R 


VOCMM 

ZPLOCIN 

ZTCHSAL 

ZADA2 

GWRKM 

GRADM 

ZCUREXP 

ZFEDIN1 

ZASSVAL 

ZPUTRANS 

2FEDIN2 

VOCEDM 

ENROL 


O.76967 
0. 83458 
0.85357 
0.90153 
0.91466 
0.93087 
0.94860 
0.95530 
0.95917 
0.96130 

0.96203 
O.96226 
0.96263 


R    SQUARE 

0.59239 
0.69652 
0.72857 
0.81275 
O.8366I 
0.86652 
0.89984 
0.91260 
0.92002 
0.92409 
0.92550 
0.92594 
0.92666 


RSQ  CHANGE 

0.59239 
0.10413 

0.03206 
0.08417 
0.02386 
0.02991 
0.02991 
0.01277 
0.00741 
0.00408 
0.00141 

0.00043 

0.00072 


SIMPLE  R 

O.76967 
0.15112 
0.15174 
0.72757 
0.33995 
0.515^1 
0.515^1 
0.33111 
0.01203 
0.25122 
0.7^870 
0.72581 
0.51380 


Table  VIII  shows  that  there  was  a  significant  reduction  in 
the  variation  in  recruiting  effort  (MMRCTR)  by  knowing  the 
vocational  male  minority  enrollment  (VOCMM)  in  a  school  dis- 
trict.  That  is,  with  VOCMM  alone  the  amount  of  explained 
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variation  is  nearly  60%   (R2  equals  0.59239),  when  predicting 
MMRCTR.   To  further  illustrate  this  point,  the  mean  of  MMRCTR 
is  59.690  and  the  standard  deviation  is  8^.860.   In  the  first 
step  of  the  regression  of  MMRCTR  with  the  12  predictor  school 
variables  when  VOCMM  was  added  the  standard  error  of  the  esti- 
mate (SEE)  was  60.^63.   This  means  that  the  width  of  a  confi- 
dence interval  about  the  predicted  number  of  recruited  man- 
months  of  effort  (MMRCTR)  is  reduced  by  about  29fa   just  by 
knowing  the  value  of  VOCMM.   Further  inclusion  of  the  other  11 
variables  reduced  the  standard  error  to  39.177.   Referring  to 
Table  VIII  it  can  be  seen  that  the  R-square  value  combining 
all  predictors  was  0. 92666.   This  means  that  nearly  93%  of 
the  variation  in  predicting  MMRCTR  is  explained  by  the  predic- 
tor variables.   However,  looking  at  the  change  in  R-square 
(R  )  it  appears  that  the  last  five  variables  shown  in  Table 
VIII  do  not  add  significantly  to  the  predictive  power. 

The  meaning  of  the  regression  analysis  of  MMRCTR  with  the 
12  predictor  variables  is  that  the  amount  of  recruiting  effort, 
measured  in  terms  of  recruiter  man-months  (MMRCTR) ,  of  the 
aggregated  RSSs  used  in  this  study  can  be  fairly  accurately 
predicted  knowing  the  enrollment  of  male  minority  students. 
If  the  percent  of  income  which  is  local  is  also  known  then 
the  amount  of  explained  variation  in  predicting  MMRCTR  jumps 
10%   to  69^.   Knowing  additionally  the  average  high  school 
teacher's  salary  and  the  average  daily  attendance  (ZTCHSAL 
and  ZADA2)  increases  the  ability  to  predict  with  81%  of  the 
variation  in  MMRCTR  explained. 
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A  comparison  was  made  of  the  29  aggregated  recruiting 
substations  in  the  sample  by  dividing  each  of  the  enrollment 
variables  by  the  recruiting  effort  (MMRCTR)  of  each  RSS .   The 
results  are  shown  in  Table  IX.   Judging  from  these  results 
there  are  inconsistencies  in  the  method  of  assigning  recruit- 
ing effort  for  recruitment  among  the  aggregated  RSSs.   If 
recruiting  effort  were  based  on  some  aspect  of  high  school 
student  enrollment  or  male  graduates  a  fairly  equal  distri- 
bution would  be  seen  in  Table  IX.   In  the  absence  of  any 
numerical  patterns  among  the  29  RSSs  aggregated  for  this  study 
it  is  concluded  that  some  basis  other  than  high  school  enroll- 
ment is  used  to  assign  recruiting  effort.   It  might  be  that 
the  frequency  of  3's  in  the  C0N12X  column  indicates  that  the 
number  of  contracts  tallied  by  the  12th  MCD  for  FY-75  was 
evenly  distributed  among  the  recruiting  effort  appplied-- 
MMRCTR . 

D.   CROSS-VALIDATION  OF  THE  C0N12AJ  MODEL 

The  13  remaining  aggregated  RSS  cases  purposely  excluded 
from  the  analysis  to  this  point  were  next  used  to  test  the 
power  of  the  C0N12AJ  model  to  predict  productivity.   The  method 
used  was  to  multiply  each  of  the  12  predictor  variables  by  the 
partial  regression  coefficients  as  discussed  in  section  B.^. 
These  variables  were  coded  as  'P'  variables  indicating  that 
they  were  being  used  to  predict  productivity  for  the  sample 
of  13  remaining  RSSs.   The  Pearson  product-moment  correlation 
coefficient  for  C0N12AJ  and  the  predicted  productivity  for 
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this  remaining  smaple  of  13  RSSs--C0N12AJP  was  calculated  as 
a  measure  of  the  goodness  of  the  predictions.   The  correlation 
was  found  to  be  only  0.0 781,  indicating  poor  agreement  between 
predicted  and  actual  contracts. 

The  results  of  the  cross-validation  of  the  C0N12AJ  model 
are  shown  in  Table  X. 

TABLE  X 

Comparison  of  Predicted  Productivity  and  Acutal 
Productivity  as  a  Suggested  Measure 
of  Effectiveness 
(N=13) 


CASE-N 

MMRCTR 

C0N12AJ 

C0N12AJP 

MOE 

1 

38 

3 

2 

1.50 

2 

133 

3 

2 

1.50 

3 

20 

2 

2 

1.00 

ij. 

5^ 

2 

2 

1.00 

5 

36 

3 

k 

0.75 

6 

65 

2 

2 

1.00 

7 

17 

11 

3 

3.67 

8 

i+9 

2 

2 

1.00 

9 

7^ 

3 

2 

1.50 

10 

19 

2 

2 

1.00 

11 

33 

2 

3 

0.67 

12 

12 

2 

3 

0.67 

13 

2^ 

7 

2 

3.50 

A  comparison  of  the  actual  observations  (C0N12AJ)  with  the 
predicted  observations  (C0N12AJP)  shows  that  the  difference 
rarely  exceeded  one  contract.   Thus,  the  low  correlation 
notwithstanding,  the  agreement  between  C0N12AJP  and  C0N12AJ 
was  fairly  good.   The  differences,  although  usually  of  at 
most  one  contract  are  magnified  in  the  correlation  calculation 
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"because  of  the  restricted  range  (low  variability)  of  C0N12AJ. 
For  this  reason,  the  low  correlation  is  somewhat  misleading. 
The  measure  of  effectiveness  (MOE)  displayed  in  Table  X 
is  the  ratio  of  actual  contracts  (productivity)  to  predicted 
contracts,  i.e . , 

MOE  =   C0N12AJ 
MUJi    C0N12AJP 

If  the  regression  model  had  good  predictive  ability,  such  a 
ratio  would  be  useful  as  an  index  for  evaluating  the  effective- 
ness of  a  recruiting  substation.   A  value  of  the  MOE  signifi- 
cantly larger  than  one  (1.00)  would  indicate  a  very  effective 
recruiting  substation.   Whereas  a  value  significantly  less 
than  one  (1.00)  would  indicate  a  substation  which  required 
attention.   For  example,  in  case  #7  of  Table  X  the  MOE  was 
found  to  be  3-67  indicating  that  this  substation  had  recruited 
almost  four  times  the  number  of  recruits  that  were  predicted. 

Because  of  the  low  variability  of  C0N12AJ  from  one  recruit- 
ing substation  to  another,  it  is  not  obvious  that  the  informa- 
tion about  the  environmental  factors  significantly  improves 
the  ability  to  predict  the  number  of  contracts  over  the  use 
of  a  simple  average  number  of  contracts  per  recruiter. 
Regardless  of  the  territorial  characteristics  the  recruiting 
substations  examined  in  this  study  appeared  to  meet  their 
productivity  goals. 
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IV.   CONCLUSIONS 
A.   FINDINGS  OF  THE  STUDY  REGARDING  PRODUCTIVITY 

This  study  attempted  to  predict  recruiting  productivity 
of  Marine  Corps  recruiting  substations  in  the  12th  Marine  Corps 
District's  California  recruiting  area.   The  prediction  was 
based  on  12  predictor  variables  which  described  the  financial 
and  enrollment  characteristics  of  the  California  Public  School 
System. 

The  dominance  of  recruiting  effort,  represented  by  NRCTRS 
or  MMRCTR,  confounded  the  analysis  by  accounting  for  an  over- 
whelming amount  of  the  variation  in  productivity  (CONCMC  or 
C0N12) .   To  take  out  the  effect  of  recruiting  effort  two  models 
were  tested.   Both  used  a  productivity  variable  which  was 
normalized  by  recruiting  effort.   The  CONCADJ.  model  which 
used  CONCMC  divided  by  NRCTRS  as  the  adjusted  productivity 
variable  showed  a  combined  effect  of  the  12  predictors  to 
explain  only  29^  of  the  variation  in  productivity--CONCADJ . 
The  C0N12AJ  model,  which  used  C0N12  divided  by  MMRCTR  as  the 
adjusted  productivity  variable,  showed  a  combined  ability  of 
the  12  predictor  variables  to  explain  6ofo   of  the  variation 
in  productivity.   This  C0N12AJ  model  was  used  to  predict  what 
productivity  would  be  with  the  13  RSS  cases  which  were  held 
aside  from  the  total  of  ^2  aggregated  RSS  cases  in  the  beginning 
of  the  study  for  cross-validation  of  the  model  produced  in 
the  study.   The  cross-validation  showed  that  the  predictive 

power  of  the  C0N12AJ  model  was  not  very  strong. 
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B.  THE  HUMAN  ELEMENT  WAS  IGNORED 

This  study  concentrated  on  quantifiable  data  describing 
the  school  districts  which  make  up  the  California  public 
school  system.   This  data  it  was  hoped  would  be  descriptive 
of  the  school  system,  relative  wealth  of  the  territory,  pupil 
dispersion,  and  some  racial  compositional  information.   The 
study  neglected  to  consider  the  psychological  makeup  of  the 
recruiter  or  the  prospective  recruits  he  was  seeking.   In  the 
introduction  to  this  study  there  were  several  studies  described 
which  used  surveys  and  attempted  to  assess  factors  affecting 
"quality"  of  recruits.   These  studies  revealed  no  particular 
military  "type"  was  evident  in  the  environment  the  recruiter 
worked  in. 

The  belief  that  there  are  areas  with  a  high  propensity  to 
enlist  as  stated  by  Bennett  and  Haber  /~Ref .  ^J   cannot  be 
reinforced  by  this  study's  results."  It  appears  from  the 
results  of  this  study  that  productivity  is  fairly  evenly 
distributed  among  the  recruiting  substations. 

C.  EDUCATIONAL  BASIS  FOR  ASSIGNMENT  OF  RECRUITING  EFFORT 

The  amount  of  recruiting  effort  applied  to  a  given  terri- 
tory measured  in  terms  of  recruiter  man-months  (MMRCTR)  for 
the  aggregated  recruiting  substations  of  this  study  can  be 
fairly  accurately  predicted  knowing  certain  educational  var- 
iables used  in  this  study.   If  the  enrollment  of  male  minority 
students  is  known  and  if  the  percentage  of  income  in  the 


51 


school  district  from  local  sources  is  high  the  amount  of 
recruiting  effort  (MMRCTRS)  can  be  predicted  with  69%   of 
the  variation  in  recruiting  effort  explained.   Knowing  the 
average  high  school  teacher's  salary  and  the  average  daily 
attendance  explains  another  12%  of  the  variation  in  recruit- 
ing effort.   Thus,  it  appears  that  the  amount  of  recruiting 
effort  is  greater  in  school  districts  with  substantial 
minority  male  enrollments  in  vocational  programs  and  these 
districts  are  economically  able  to  support  their  educational 
programs  with  little  state  or  federal  support. 
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